Preparing for the unpredictable: Identifying successful performance strategies in human-machine improvisation

We examine the human creative process involved in performing with Mimi (Multimodal Interaction in Musical Improvisation), a system designed for human-machine music improvisation on a keyboard or other MIDI instrument. Mimi makes use of a factor oracle data structure to generate new musical material based on seed material from a human performer. Used in conjunction with a MIDI interface that gives the performer operational control over Mimi and a visualization scheme that gives the performer advance notice of Mimi’s actions, this system presents opportunities and challenges for the improvising musician that differ from other improvisational contexts in significant ways. This study identifies and examines some strategies for successful performance with the system, including managing interpolations, transitions, and formal design, with implications for pedagogy and for future development of human-machine improvisation systems.